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BEYOND  EIGENVALUES 


Lloyd  N.  Trefethtid ,  Amu  E.  Trefrlhni^ ,  Satish  C.  Reddy^ ,  Tobin  A.  DriscolT 

ABSTRACT 

Fluid  flows  that  are  smooth  at  low  speeds  become  unstable  and  then  turbulent  at  higher 
speeds.  This  phenomenon  has  traditionally  been  investigated  by  linearizing  the  equations 
of  flow  and  looking  for  unstable  eigenvalues  of  the  linearized  problem,  but  the  results  agree 
poorly  in  many  cases  with  experiments.  Nevertheless,  it  has  become  clear  in  recent  years 
that  linear  effects  play  a  central  role  in  hydrodynamic  instability.  A  reconciliation  of  these 
findings  with  the  traditional  analysis  can  be  obtained  by  considering  the  “pseudospectra”  of 
the  linearized  problem,  which  reveal  that  small  perturbations  to  the  smooth  flow  in  the  form 
of  streamwise  vortices  may  be  amplified  by  factors  on  the  order  of  10^  by  a  linear  mechanism, 
even  though  all  the  eigenmodes  are  stable.  The  same  principles  apply  also  to  other  problems 
in  the  mathematical  sciences  that  involve  non-orthogonal  eigenfunctions. 
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Introduction 

A  change  of  paradigm  is  taking  place  in  the  field  of  hydrodynamic  stabil¬ 
ity.  This  is  the  field  devoted  to  the  study  of  how  laminar  fluid  flows  become 
unstable,  the  precursor  to  turbulence  (1,  2).  It  is  well  known  that  turbulence 
is  an  unsolved  problem,  but  not  so  well  known  that  despite  the  efforts  of  gen¬ 
erations  of  applied  mathematicians  beginning  with  Stokes,  Kelvin,  Rayleigh, 
and  Reynolds  a  century  ago,  many  of  the  presumably  simpler  phenomena  of 
hydrodynamic  stability  also  remain  ill-understood  (3). 

The  traditional  paradigm  is  eigenvalue  analysis: 

I.  Linearize  about  the  laminar  solution; 

II.  Look  for  unstable  eigenvalues  of  the  linearized  problem. 

An  “unstable  eigenvalue”  means  an  eigenvalue  in  the  complex  upper  half-plane, 
corresponding  to  an  eigenmode  of  the  linearized  problem  that  grows  exponen¬ 
tially  as  a  function  of  time  t.  It  is  natural  to  expect  that  a  flow  will  behave 
unstably  if  and  only  if  there  exists  such  a  growing  eigenmode,  and  over  the 
years  a  great  deal  of  knowledge  has  been  obtained  about  which  flows  possess 
such  modes,  a  distinction  that  depends  on  the  geometry,  the  Reynolds  number, 
and  sometimes  other  parameters. 

For  some  flows,  the  predictions  of  eigenvalue  analysis  match  laboratory  ex¬ 
periments.  Examples  are  Rayleigh- Benard  convection  (a  stationary  fluid  heated 
from  below)  and  Taylor-Couette  flow  (between  a  stationary  outer  and  a  rotating 
inner  cylinder).  For  other  flows,  the  predictions  of  eigenvalue  analysis  fail  to 
match  most  experiments.  In  this  article  we  consider  the  two  most  extensively 
studied  examples  of  this  kind:  (plane)  Couette  flow,  the  flow  with  a  linear  ve¬ 
locity  profile  between  two  infinite  flat  plates  moving  parallel  to  one  another, 
and  (plane)  Poiseuille  flow,  the  flow  with  a  parabolic  velocity  profile  between 
two  stationary  plates  (Fig.  1).  Other  examples  where  eigenvalue  analysis  fails 
include  pipe  Poiseuille  flow  (in  a  cylindrical  pipe)  and,  to  a  lesser  degree,  Blasius 
boundary  layer  flow  (near  a  flat  wall). 

For  Poiseuille  flow,  eigenvalue  analysis  predicts  a  critical  Reynolds  number 
(4)  i2  =  5772.22  at  which  instability  should  first  occur  (5),  but  in  the  laboratory, 
transition  to  turbulence  is  observed  at  Reynolds  numbers  as  low  as  Rm  1000  (6). 


Fig.  1.  Velocity  profiles  for  the  two  laminar  flows  considered  in  this  article 
(independent  of  x  and  2).  The  geometry  is  an  infinite  3D  slab  of  viscous 
incompressible  fluid  bounded  by  parallel  walls.  The  laminar  solutions  sat¬ 
isfy  the  Navier-Stokes  equations  for  aU  Reynolds  numbers  Jl,  but  for  higher 
Ji  the  flows  are  unstable  and  rapidly  become  turbulent. 

For  Couette  flow,  eigenvalue  analysis  predicts  stability  for  all  B,  but  transition 
is  observed  for  Reynolds  numbers  as  low  as  i?w350  (7).  These  anomalies  of 
“subcritical  transition  to  turbulence”  have  been  recognized  for  many  years,  and 
the  explanation  has  usually  been  attributed  to  step  1  above.  If  linearization  has 
failed,  the  reasoning  goes,  one  must  look  more  closely  at  the  nonlinear  terms, 
or  perhaps  linearize  about  a  solution  other  than  the  laminar  one  (the  theory  of 
“secondary  instability”  (8,  9)). 

Recently  it  has  emerged,  however,  that  the  failure  of  eigenvalue  analysis 
may  more  justly  be  attributable  to  step  II.  It  is  a  fact  of  linear  algebra  that 
even  if  all  of  the  eigenvalues  of  a  linear  system  are  distinct  and  lie  well  inside 
the  lower  half-plane,  inputs  to  that  system  may  be  amplified  by  arbitrarily  large 
factors  if  the  eigenfunctions  are  not  orthogonal.  A  matrix  or  operator  whose 
eigenfunctions  are  orthogonal  is  said  to  be  normal  (10,  11).  The  linear  operators 
that  arise  in  the  Benard  and  Taylor-Couette  problems  are  normal  or  close  to 
normal.  By  contrast  Reddy,  Schmid  and  Henningson  discovered  in  1990  that  the 
operators  that  arise  in  Poiseuille  and  Couette  flow  are  in  a  sense  exponentially 
far  from  normal  (12).  At  about  the  same  time  the  startling  discovery  was  made 
by  Gustavsson  (13)  and  Henningson  (14)  and  independently  by  Butler  and 
Farrell  (15)  that  small  perturbations  to  these  flows  may  be  amplified  by  factors 
of  many  thousands,  even  when  all  the  eigenvalues  are  in  the  lower  half-plane. 
The  paper  by  Butler  and  Farrell  is  an  important  and  elegant  one.  It  discusses 
many  details  omitted  here,  and  together  with  a  related  more  recent  paper  by 


Trefcthen,  Trefethen,  Reddy  and  Driscoll  -  4 


10^  10“*  10®  2x10® 


Fig.  2.  Maximum  possible  amplification  of  3D  perturbations  in  linearized 
Poiseuille  flow  as  a  function  of  Reynolds  number  R  and  x-z  wave  number 
magnitude  k  =  +  In  the  black  region,  with  leftmost  point  R  =  5772, 

unstable  eigenmodes  exist  and  unbounded  amplification  is  possible.  The 
contours  outside  that  re^on  correspond  to  finite  amplification  factors  of 
10^,  10**  (dashed),  and  1  X  10®,2  x  10®,...,1.3  x  10®.  For  example,  ampli¬ 
fication  by  a  factor  of  1000  is  possible  for  all  A  >  549.  In  the  laboratory, 
transition  to  turbulence  is  observed  at  ^  « 1000.  The  analogous  picture 
for  Couette  flow  looks  qualitatively  similar  except  that  there  is  no  black 
region. 


Reddy  and  Henningson  (16),  it  forms  the  foundation  of  the  present  work  (17). 

Fig.  2  illustrates  these  factors  of  thousands.  The  black  region  has  appeared 
in  many  papers  and  books  and  corresponds  to  parameters  for  which  unstable 
eigenmodes  exist  (18).  The  contours  defining  the  shaded  regions  are  new  and 
quantify  the  non-modal  amplifications  that  may  occur  in  these  flows.  (A  precise 
explanation  of  this  plot  is  given  in  the  next  section.)  The  possibility  of  ampli¬ 
fication  of  perturbations  of  viscous  flows  by  non-modal  linear  mechanisms  has 
been  recognized  for  a  century  (19-23),  but  until  the  recent  developments,  it  was 
not  known  that  the  magnitudes  involved  were  huge. 
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An  essential  feature  of  the  amplification  process  of  Fig.  2  is  that  it  acts 
upon  3D  perturbations  of  the  laminar  flow  field.  In  much  of  the  theoretical 
literature  of  hydrodynamic  stability,  attention  has  been  restricted  to  2D  (x-t/) 
perturbations,  and  in  particular,  the  well-known  Orr-Sommerfeld  equation  is 
an  eigenvalue  equation  for  2D  perturbations.  A  principal  justification  for  this 
restriction  has  been  Squire’s  theorem  of  1933,  which  asserts  that  if  a  flow  has  an 
unstable  3D  eigenmode  for  some  R,  then  it  has  an  unstable  2D  eigenmode  for 
some  lower  value  of  R  (24).  The  new  results  indicate  that  this  emphasis  on  2D 
perturbations  has  been  misplaced.  When  only  2D  perturbations  are  considered, 
amplification  is  still  possible,  but  far  weaker. 

This  emphasis  on  3D,  linear  but  non-modal  effects  is  the  emerging  new 
paradigm  in  hydrodynamic  stability. 


Streamwise  vortices  and  streaks 

The  flow  features  associated  with  this  amplification  process  have  a  distinc¬ 
tive  form  (Fig.  3): 

Input:  streamwise  vortex, 

Output:  streamwise  streak. 

A  streamwise  vortex  is  an  elongated  region  of  Vorticity  approximately  aligned 
with  the  X  axis,  and  a  streamwise  streak  is  an  elongated  region  of  high  or  low 
velocity  (relative  to  the  mean  flow)  approximately  in  the  x  direction.  Streamwise 
vortices  and  streaks  are  persistent  features  in  laboratory  experiments  involving 
all  kinds  of  internal  and  boundary  layer  shear  flows  (25).  Physically,  they  are 
not  hard  to  explain:  in  a  shear  flow,  a  small  perturbation  in  the  form  of  a 
streamwise  vortex  may  move  fluid  from  a  region  of  higher  to  lower  x  velocity, 
or  vice  versa,  where  it  will  appear  as  a  large  local  perturbation  in  the  x  velocity 
(26).  Since  these  features  constitute  3D  perturbations  of  the  flow  field,  however, 
their  prevalence  hats  been  difficult  to  reconcile  with  the  predictions  of  eigenvalue 
analysis.  Non-modal  analysis  offers  a  resolution  of  this  difficulty,  for  although 
streamwise  streaks  are  not  eigenmodes  of  the  linearized  flow  problem,  they  are 
pseudomodes. 

To  explain  this  term  and  our  use  of  the  words  “input”  and  “output,”  we 
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Fig.  3.  Schematic  illustration  of  a  structure  that  appears  in  many  shear 
flows.  A  low-amplitude  vortex  or  counter-rotating  pair  of  vortices  roughly 
aligned  with  the  flow  entrains  fluid  from  regions  of  high  to  low  x  velocity 
and  vice  versa.  The  entrained  fluid  appears  as  a  streak  of  locally  high  or 
low  stream  wise  velocity  (not  shown).  This  process  is  linear,  but  unrelated 
to  eigenmodes. 

must  define  the  evolution  operator  that  is  the  mathematical  basis  of  this  article. 
Let  Ufl  =  UQ^x^y^z)  denote  the  vector  velocity  field  corresponding  to  Poiseuille 
or  Couette  laminar  flow  (Fig.  1).  Let  UQ  +  u{t)=^UQ{x,y,z)  +  u{x,y,z,t)  be  the 
velocity  field  of  a  slightly  perturbed  flow,  i.e.,  a  nearby  solution  to  the  Navier- 
Stokes  equations.  (We  use  bold  face  letters  to  distinguish  quantities  that  are 
functions  of  f.)  If  we  take  u  to  be  infinitesimal,  then  it  satisfies  an  equation 

du ,  ,  . ,  X 

—(f)  =  -^£u(f), 

where  £  is  a  linear  operator  that  we  call  the  linearized  Nnvier-Stokes  evolution 
operator.  (The  factor  ~i  =  —\/^  is  a  matter  of  convention.)  As  a  measure  of 
the  size  of  solutions  to  this  equation  we  define 

llu(f)||  =  (y  \u{x,y,z,t)fdxdydz^  , 

which  we  call  the  energy  norm  since  its  square  corresponds  to  energy. 

Suppose  now  that  the  linearized  fluid  system  is  driven  by  a  signal  of  the 
form  v(f)  =  e~*^*v  for  some  frequency  u;  €  C  and  function  v  =  i;(a:, y,  z): 

^(<)  =  —iCu{t)  +  e~'^*v,  —oo<t  <oc. 
dt 

It  is  easily  verified  that  the  response  will  be 

u(f)  =  ie~*^^u, 


V  =  {u}I  —  C) 
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where  I  denotes  the  identity  operator.  Thus  the  operator  (ujI  —  C)  \  known  as 
the  resolvent  of  C,  transforms  “inputs”  v  to  the  linearized  fluid  flow  at  frequency 
uj  into  corresponding  “outputs”  u  (10,  11).  The  degree  of  amplification  that  may 
occur  in  the  process  is  equal  to  the  operator  norm 

11/  T  /-A-llI  ll“ll 

\\{(^I-C)  11  =  sup—. 

v^Q  Fll 

Since  an  arbitrary  time-dependent  perturbation  of  the  laminar  flow  can  be  re¬ 
duced  to  an  integral  over  real  frequencies  by  Fourier  analysis,  values  of  u;  on  the 
real  axis  are  of  particular  interest.  The  maximum  possible  amplification  over 
all  real  frequencies  is  supj^gK  ll(u;/  — £)~^||,  and  this  is  the  quantity  plotted  in 
Fig.  2. 

An  eigenvalue  of  £  is  a  number  oi  €  C  such  that  Cu  =  u)u  for  some  corre¬ 
sponding  eigenfunction  «.  Equivalently,  it  is  a  number  u;  with  the  property  that 
inputs  with  frequency  a;  can  be  amplified  unboundedly:  ll(u;/  — £)“^11  =  oo. 
More  generally,  for  any  c  >  0,  an  e-pseudo-eigenvalue  of  £  is  a  number  a; 
such  that  ll(u;/  — £)~^11  >  and  a  corresponding  e-pseudo-eigenfunction  or 
e-pseudomode  is  any  function  u  with  11£«— tuwH  <  eHuH.  If  e  is  very  small,  then 
an  e-pseudomode  u  may  be  excited  to  a  substantial  amplitude  by  a  very  small 
input,  possibly  including  noise  in  an  experimental  apparatus.  At  R=  5000,  for 
example,  a  streamwise  streak  is  an  e-pseudomode  of  the  linearized  Poiseuille 
flow  problem  for  e  ss  1.2  x  10“^  (Fig-  2)  and  thus  can  be  excited  by  a  streamwise 
vortex  five  orders  of  magnitude  weaker  in  amplitude. 

The  set  of  e-pseudo-eigenvalues  of  an  operator  is  the  e-pseudospectrum  (27): 
A,(£)  =  {^eC:  ||(a,/-£)->||>e-‘). 

The  pseudospectra  {Aj(£)}  form  a  nested  family  of  sets  in  the  complex  plane, 
with  Ao(£)  equal  to  the  spectrum  A(£).  If  £  is  normal,  Aj(£)  is  the  set  of 
all  points  at  distance  <  e  from  A(£),  but  in  the  non-normal  case  it  may  be 
much  larger.  The  physical  significance  of  pseudospectra  can  be  described  as 
follows.  If  a  system  is  governed  by  a  linear  operator  that  is  normal  or  close  to 
normal — familiar  examples  include  musical  instruments,  oscillating  structures, 
and  molecules  as  described  by  quantum  mechanics — then  the  frequencies  at 
which  it  resonates  strongly  are  determined  by  its  spectrum.  The  resonances  of 
a  system  that  is  far  from  normal,  however,  can  only  be  understood  by  examining 
its  pseudospectra. 
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Spectra  and  pseudospectra 

Figs.  4  and  5,  the  centerpieces  of  this  article,  depict  spectra  and  pseu¬ 
dospectra  for  Couette  flow  at  iZ  =  350,  3500  and  Poiseuille  flow  at  R  =  1000, 
10000.  These  Reynolds  numbers  roughly  span  the  range  in  each  case  from  pos¬ 
sible  turbulence  (in  some  experiments)  to  unavoidable  turbulence  (even  in  ex¬ 
periments  under  the  most  carefully  controlled  conditions).  These  and  our  other 
figures  are  the  results  of  numerical  computations.  As  a  practical  matter  we  first 
Fourier  transform  in  x  and  z,  reducing  the  calculation  to  one  space  dimension 
(y)  and  two  real  parameters  a,/3  (wavenumbers  in  x,z).  The  generation  of  each 
figure  then  requires  a  minimization  in  the  a-/3  plane  (28). 

Spectra  of  for  particular  values  of  o:  and  /?  have  been  published  by  var¬ 
ious  authors  (5,  29),  and  pseudospectra  of  will  appear  in  (12,  16).  Neither 
spectra  nor  pseudospectra  of  C  itself  have  been  plotted  previously. 

Fig.  4  reveals  that  in  the  case  of  Couette  flow,  the  spectrum  of  £  is  a  contin¬ 
uous  region  contained  in  the  lower  half-plane.  (For  each  a,/?  pair  the  spectrum 
is  discrete,  but  the  union  over  a  and  0  is  a  continuum,  shown  in  the  figure  as 
a  shaded  region.)  This  is  true  for  all  R,  corresponding  to  the  unconditional 
stability  of  Couette  flow  according  to  eigenvalue  analysis.  The  spectrum  comes 
closest  to  the  upper  half-plane  along  the  imaginary  axis,  at  a  distance  0{R~^) 
as  R—*  oo.  The  pseudospectra  of  £,  by  contrast,  protrude  significantly  into  the 
upper  half-plane,  indicating  that  evolution  process  governed  by  this  operator 
will  feature  prominent  non-modal  effects. 

One  cannot  see  in  Fig.  4  what  values  of  a  and  correspond  to  various 
points  in  the  spectrum  and  pseudospectra.  The  situation  is  roughly  as  follows. 
The  upper  boundary  of  the  spectrum  corresponds  to  =  0  and  to  values  of  a 
that  grow  in  proportion  to  Rew.  In  the  pseudospectra,  the  values  of  a  are 
comparable  but  the  values  of  are  0(1).  This  difference  in  values  of  j3  reflects 
the  fact  that  although  the  dominant  eigenmodes  of  this  problem  are  2D,  the 
dominant  pseudomodes  are  3D. 

Fig.  5  reveals  the  more  complicated  situation  for  Poiseuille  flow.  The  pseu¬ 
dospectra  are  qualitatively  similar,  again  extending  well  into  the  upper  half¬ 
plane  (30).  The  boundary  of  the  spectrum,  however,  is  now  determined  by  two 
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Fig.  4.  Spectrum  and  e-pseudospectra  in  the  complex  w-plane  of  the  lin¬ 
earized  Navier-Stokes  evolution  operator  for  Couette  flow  at  ^  =  350  and 
3500.  The  spectrum  is  the  shaded  region,  and  the  solid  curves,  from  outer  to 
inner,  are  the  boundaries  of  the  e- pseudospectra  with  e  =  10“^,  10~^  ®,  10~^, 
10“^  ®.  The  spectrum  lies  in  the  lower  half- plane,  but  the  pseudospectra  ex¬ 
tend  significantly  into  the  upper  half-plane,  revealing  the  non-normality  of 
this  operator.  Note  that  the  real  and  imaginary  axes  are  scaled  differently. 
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(A)  Poiseuille,  fl=1000 


(B)  Poiseuille,  fl=  10000 


Fig.  5.  Same  as  Fig.  4  but  for  Poiseuille  flow  with  R  =  1000,  10000.  For 
R  >  5772,  two  bumps  in  the  spectrum  extend  into  the  upper  half-plane. 
However,  the  large  lobes  of  the  pseudospectra  along  the  imaginary  axis  are 
physically  more  important. 


Re(w) 


Re(u;) 
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distinct  components,  each  with  =  0.  One  of  these  looks  qualitatively  like  the 
boundary  of  the  spectrum  for  Couette  flow  and  corresponds  to  perturbations 
of  the  flow  field  that  are  symmetric  about  the  centerline.  The  other  is  very 
different,  consisting  of  bumps  on  either  side  of  the  origin  corresponding  to  an¬ 
tisymmetric  perturbations  of  the  flow.  For  lower  values  of  R,  the  spectrum  is 
contained  in  the  lower  half-plane,  but  at  i?  =  5772  the  bumps  cross  the  real 
axis.  These  bumps  represent  the  mode  that  has  received  most  of  the  attention 
in  the  literature,  which  is  sometimes  known  as  a  Tollmien-Schlichting  or  TS 
wave.  However,  their  negligible  effect  on  the  nearby  pseudospectral  contours 
reveals  that  this  mode  is  oriented  at  a  sizable  angle  to  the  remainder  of  the 
system  (31).  The  pseudomodes  associated  with  u;?a0 — streamwise  streaks  with 
Ot  ^  0,  0^0 — are  physically  more  important. 

We  can  summarize  the  implications  of  Figs.  4  and  5  by  noting  that  whereas 
spectral  analysis  suggests  that  plane  Couette  and  Poiseuille  flows  are  fundamen¬ 
tally  different,  since  one  has  unstable  eigenmodes  for  certain  values  of  R  and  the 
other  does  not,  pseudospectral  analysis  suggests  that  they  are  fundamentally 
similar,  as  is  observed  in  experiments. 


Resonance  curves 

Figs.  6  and  7  represent  slices  of  Figs.  4  and  5  along  the  real  axis.  In 
each  figure  ||(u;/ —  ||  is  plotted  as  a  function  of  u;  G  R  for  several  values 

of  R,  indicating  the  factors  by  which  linearized  Couette  and  Poiseuille  flows  are 
capable  of  amplifying  time-dependent  perturbations  at  various  real  frequencies. 
When  the  amplification  is  large  we  speak  of  the  phenomenon  of  resonance, 
although  a  more  careful  term  might  be  “pseudo-resonance.’' 

For  Couette  flow,  no  significant  resonance  is  present  except  near  a;  =  0. 
There,  the  amplification  may  be  powerful  indeed,  reaching  a  value  0{R^)  al¬ 
though  the  spectrum  lies  at  a  distance  )  below  the  real  axis.  For  Poiseuille 

flow,  the  behavior  for  a;  ~  0  is  similar,  but  for  R  >  5772  an  additional  resonance 
for  larger  ld  appears  due  to  the  unstable  eigenmode.  In  principle,  this  mode 
would  dominate  if  one  could  set  up  an  experiment  involving  a  sufficiently  long 
channel  and  a  sufficiently  smooth  flow.  Under  conditions  where  this  can  happen, 
however,  low-frequency  inputs  are  already  subject  to  non-modal  amplification 
by  a  factor  of  order  10^. 
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Transient  energy  growth 

Another  aspect  of  linear,  non-modal  instability  of  fluid  flows  is  the  transient 
amplitude  or  energy  growth  that  may  evolve  from  certain  initial  conditions.  This 
is  the  phenomenon  that  has  been  studied  in  the  recent  papers  by  Gustavsson, 
Butler  and  Farrell,  and  Reddy  and  Henningson,  where  many  more  physical 
details  can  be  found. 

Mathematically,  consider  the  initial-value  problem 

^{t)  = —iCu{t),  <>0,  u(0)  =  u. 

at 

The  solution  can  be  written  u(t)  =  exp(— where  exp(— is  the  operator 
exponential.  The  factor  by  which  such  solutions  can  grow  in  time  t  is 

||exp(-it£)||  =  sup  , 

t-/o  IpII 

and  the  energy  growth  is  the  square  of  this  quantity.  If  C  were  a  normal  operator 
with  spectrum  in  the  lower  half-plane,  we  would  have  llexp(— it£)l|  <  1  for  all 
t>0.  In  actuality,  Gustavsson  and  Butler  and  Farrell  discovered  that  the  growth 
is  ||exp(— e^£)||  =  0(i?),  making  the  energy  growth  0{B?). 

Fig.  8  illustrates  this  phenomenon  for  Couette  flow  at  various  Reynolds 
numbers.  The  agreement  of  the  curves  for  finite  R  and  R  =  oo  can  be  explained 
as  follows:  the  streamwise  vortex/streak  mechanism  of  energy  growth  is  inviscid, 
and  operates  on  a  time  scale  0{R)  before  being  shut  off  by  the  effects  of  viscosity. 
Such  behavior  is  physically  straightforward,  appearing  complicated  only  when 
interpreted  in  the  basis  of  eigenmodes. 

Fig.  9  gives  further  information  for  Couette  flow  with  R  =  350;  other 
Reynolds  numbers  are  qualitatively  similar.  The  restriction  to  ^-independent 
flows  (a  =  0)  curtails  the  transient  growth  somewhat  for  small  t  but  has  no  ef¬ 
fect  for  larger  f,  when  the  maximal  growth  is  achieved  with  q  =  0  anyway  (i.e., 
a  purely  streamwise  structure).  The  restriction  to  2-independent  flows  (/?  =  0), 
however,  has  a  huge  effect,  shutting  off  most  of  the  transient  growth  except  for 
(32). 

The  0{R^)  resonances  of  Figs.  2,6,7  are  approximately  equal  to  the  inte¬ 
grals  under  the  curves  in  Figs.  8  and  9.  Mathematically,  this  can  be  seen  from 
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Fig,  8.  Non- modal  transient  energy  growth  for  Couette  flow.  For  any 
finite  R,  the  effect  of  viscosity  shuts  off  the  growth  on  a  time  scale  0(R). 


Fig.  9.  Transient  growth  for  Couette  flow  at  i?  =  350.  Little  growth  occurs 
when  only  2D  perturbations  are  allowed. 
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Fig.  10.  Analogue  of  Fig.  2,  showing  transient  energy  growth  factors 
suPoo  II  exp(-it£)|p  instead  of  resonant  amplification  factors  sup^^gj^  ||(w/- 
C)~^  II .  For  example,  transient  energy  growth  by  a  factor  of  1000  is  possible 
for  all  >  2260.  If  C  were  normal,  the  growth  factors  would  be  exactly  1 
outside  the  black  region. 


000 


the  formula  =i  €\p{—itC)dt,  which  implies  ||£“^||  <  /o”  ||exp(  — if£)||  dt, 
in  practice  the  inequality  is  typically  within  a  factor  of  2  of  equality.  We  can 
interpret  the  0{B?)  result  physically  by  noting  that  the  resonant  amplification 
is  due  to  a  combination  of  two  effects:  one  (normal)  factor  0{R)  representing 
the  time  scale  over  which  input  energy  can  accumulate  before  it  eventually  de¬ 
cays,  and  another  (non-normal)  factor  0(R)  representing  transient  amplitude 
growth. 

Analogues  of  Figs.  8  and  9  for  Poiseuille  flow  look  qualitatively  the  same; 
the  differences  for  R>  5772  appear  only  for  large  f,  off  the  scale  of  our  plots. 
Fig.  10  is  an  analogue  of  Fig.  2  for  the  Poiseuille  case  that  shows  transient 
energy  growth  factors  instead  of  resonance  amplitudes  (33). 

A  lower  bound  for  transient  growth  factors  can  be  derived  from  the  geom- 
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etry  of  the  pseudospectra  in  the  complex  upper  half-plane.  One  can  show: 

sup  ||exp(— itjC)||  >  sup 

<>0  f>0 

where  (Tf{C)  =  sup^^gy^^(£)  Imo;  is  the  e-pseudospectral  ordinate  of  C  (11,  16). 
In  words,  if  the  pseudospectra  protrude  far  into  the  upper  half-plane,  then  sub¬ 
stantial  transient  energj'  growth  must  be  possible.  The  horizontal  line  segment 
in  Fig.  9  marks  this  lower  bound,  which  falls  short  of  the  true  maximum  by 
only  about  a  factor  of  1.4  in  amplitude  or  2.0  in  energy,  numbers  typical  of  both 
Couette  and  Poiseuille  flows  for  a  wide  range  of  R  (3,  34). 


Physically  interesting  pseudomodes 

Instead  of  operator  norms,  it  is  customary  in  the  literature  to  investigate 
the  evolution  of  particular  solutions  chosen  for  one  physical  recison  or  another. 
The  amplitude  history  of  the  solution  with  initial  flow  field  u(0)  =  v  is  given  by 
||exp(— it£)u||,  and  the  upper  envelope  of  all  such  curves,  corresponding  to  all 
initial  functions  v,  is  the  operator  norm  |jexp(— it£)||  that  we  have  discussed. 

Three  choices  of  v  with  particular  claims  to  attention  can  be  identified 
with  the  aid  of  the  singular  value  decomposition  (SVD),  the  natural  tool  for  all 
kinds  of  questions  involving  norms  and  extrema  of  nonsymmetric  matrices  and 
operators  (35).  Fig.  11  displays  the  curves  ||exp(— i<£)u||  corresponding  to  the 
principal  right  singular  vectors  of  the  following  operators: 

Uj :  exp(— 10"*'£)  (maximal  initial  growth  rate), 

^2  :  exp(—itoptJC)  (maximal  total  growth), 

U3 :  £“*  (maximal  resonance). 

The  function  Uj  is  the  perturbation  with  maximal  growth  rate  at  t  =  0,  a  function 
that  has  been  studied  by  Serrin,  Busse,  Joseph,  Lumley,  and  others  (2,  8,  15, 
36).  (The  notation  exp(— i0'*'£)  indicates  the  limit  of  the  SVD  of  exp(— it£) 
as  <  -4  0.  A  cleaner  and  computationally  more  appropriate  characterization  of 
the  function  Uj  is  that  it  is  the  principal  eigenfunction  of  {C  —  C*)/2i,  with 
growth  rate  at  t  =  0  equal  to  the  corresponding  eigenvalue,  or  equivalently,  to 
the  distance  that  the  numerical  range  of  C  protrudes  into  the  upper  half-plane.) 
The  function  V2  is  the  Butler-Farrell  “optimal”  that  achieves  maximal  total 


Trefethen,  Trefethen,  Reddy  and  Driscoll  -  17 


Fig.  11.  Initial  growth  and  eventual  decay  resulting  from  three  particular 
initial  perturbations  v  for  Couette  flow  at  i?  =  350.  The  dashed  curve  is 
the  operator  norm  of  Fig.  9. 

growth  at  some  time  t  =  fopt-  The  function  is  the  one  that  excites  a  maximal 
resonant  response  in  the  sense  of  Figs.  2,6,7. 

Fig.  11  reveals  that  although  the  physical  ideas  behind  the  functions  Uj, 
^2,  ^3  are  different,  i>2  and  at  least  lead  to  comparable  energy  growth.  These 
functions  are  also  similar  in  structure:  both  have  approximately  the  form  of 
stream  wise  vortices  that  evolve  into  streamwise  streaks  (corresponding  to  left 
rather  than  right  singular  vectors  of  the  same  operators).  An  analogous  figure 
for  Poiseuille  flow  looks  roughly  similar,  but  the  gap  between  V2  and  U3  is  smaller 
and  the  gap  between  these  and  Uj  is  larger. 
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The  inviscid  limit 

The  relationship  between  the  stability  theories  for  viscous  and  inviscid  flows 
has  been  an  awkward  one  (21).  It  is  natural  to  expect  that  the  mechanism  of 
instability  should  be  essentially  inviscid,  so  that  it  should  be  possible  to  get  at 
the  essence  of  the  matter  by  setting  R  =  oo,  simplifying  the  equations  greatly. 
Yet  the  results  of  inviscid  stability  analysis  have  generally  matched  neither  the 
results  of  viscous  analysis  nor  experimental  observations.  A  conspicuous  exam¬ 
ple  is  Rayleigh’s  theorem  of  1880  (37),  which  asserts  that  unless  the  velocity 
profile  contains  an  inflection  point,  an  inviscid  parallel  shear  flow  is  always  sta¬ 
ble,  a  conclusion  plainly  at  odds  with  the  observed  behavior  of  Poiseuille  and 
Couette  flows  at  large  finite  Reynolds  numbers. 

We  believe  that  much  of  the  difficulty  with  the  limit  R  — >  oo  has  been  due 
to  misunderstanding  of  the  significance  of  eigenvalues.  Rayleigh’s  theorem,  like 
Squire’s  theorem,  is  actually  a  statement  about  the  existence  of  eigenvalues  in 
the  upper  half-plane,  and  like  Squire’s  theorem,  it  is  mathematically  correct  but 
misleading.  If  one  defines  stability  by  energy  growth  instead  of  by  eigenvalues, 
one  finds  that  every  planar  shear  flow  with  R  =  oo  is  unstable,  regardless  of  the 
velocity  profile.  This  observation  is  due  to  Ellingsen  and  Palm  (38),  with  roots 
going  back  to  Kelvin,  and  related  results  have  been  established  by  many  others 
(23,  39).  The  example  of  Couette  flow  with  R  =  oc  and  a  =  0  is  particularly 
simple,  for  the  equations  reduce  to  the  2x2  block  matrix  problem 


where  v  and  fj  represent  the  y  components  of  velocity  and  vorticity  (functions 
of  y,  after  Fourier  transformation  in  x  and  z).  The  matrix  L  in  this  equation 
is  defective  (i.e.,  nondiagonalizable),  with  ||exp(  — ?<Z,)||  ~ a»s  t—*oc  for  some 
constant  C  =  C{0)  <  1  (after  transformation  to  the  energy  norm).  Thus  inviscid 
Couette  flow  is  linearly  unstable,  even  though  there  is  no  exponentially  growing 
eigenmode,  which  explains  the  dashed  line  in  Fig.  8. 

This  “algebraic”  instability  of  inviscid  flows  is  well  known  among  hydro- 
dynamicists.  What  has  been  missing  is  a  fully  satisfactory  link  to  the  case  of 
viscous  flows,  where  the  evolution  operator  is  typically  nondefective  and  eigen¬ 
value  analysis  has  been  accepted  as  a  test  of  stability.  The  point  that  has  not 
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always  been  appreciated  is  that  although  a  flow  may  be  stable  in  the  sense  of 
bounded  response  to  infinitesimal  perturbations  for  each  finite  R,  it  does  not 
follow  that  it  satisfies  any  bound  uniformly  as  — >  oc.  In  the  absence  of  a 
uniform  bound,  the  notion  of  stability  for  large  finite  Reynolds  numbers  has 
little  meaning  (40). 

Our  computations  indicate  that  by  most  measures,  the  limit  i?  — >  oo  is  a 
smooth  one.  Table  1  summarizes  the  behavior  of  a  number  of  quantities  in  this 
limit  and  may  serve  as  a  reference  point  for  most  of  our  figures  (41). 


Couette 

a 

/3 

Poiseuille 

Ot 

distance  of  spectrum  from  real  axis 

(fi/2.47)-‘ 

0 

0 

(/7/2.47)-» 

0 

0 

max.  resonance  sup^gj^ ||(u;/  — £)“'|| 

(R/8.12)2 

0 

1.18 

(77/17.4)2 

0 

1.62 

transient  growth  sup,>olkxp(~*^£)lP 

(ii/29.1)2 

35.7/77 

1.60 

(77/71.5)2 

0 

2.04 

optimal  time  topt 

/Z/8.52 

77/13.2 

lower  bound  based  on  pseudospectra 

(i?/42.6)2 

0 

1.62 

(77/103. )2 

0 

2.04 

transient  growth  (o  =  0) 

(R/29.3)2 

0 

1.66 

(77/71.5)2 

0 

2.04 

Table  1.  Leadiag-order  behavior  of  various  quantities  as  R  —  oo.  These 
formulas  are  accurate  to  at  least  1%  for  all  R  >  100.  The  results  for 
Poiseuille  flow  pertain  to  the  highly  non-normal  part  of  the  problem,  ig¬ 
noring  the  R  >  5772  mode  (TS  wave). 


Destabilizing  perturbations  and  secondary  instability 

There  is  an  alternative,  equivalent  definition  of  the  pseudospectra  of  an 
operator  C,  (27,  42): 

Af(£)  =  closure{w€C:  w€A(£-f£)  for  some  £*  with  ||£||<c}. 

In  words,  the  e-pseudospectrum  of  £  is  the  union  of  the  spectra  of  all  perturbed 
operators  £  +  5  with  ||£||  <  c,  together  with  any  limit  points  of  this  set  (a  tech¬ 
nicality  of  little  importance).  It  is  interesting  to  reconsider  the  implications 
of  Figs.  4  and  5  in  the  light  of  this  alternative  characterization.  The  pseu- 
dospectral  boundary  contours  in  these  figures  imply  that  although  the  flows  in 
question  are  eigenvalue  stable  (for  R<hll2  in  the  Poiseuille  ca.se),  exceedingly 
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Fig.  12.  An  eigenvalue  stable  shear  flow  at  Reynolds  number  R  can  be 
destabilized  by  a  linear  operator  perturbation  S  of  norm  = 
the  dependence  is  so  nearly  quadratic  that  the  curves  appear  straight  to 
plotting  accuracy.  The  inverse  =  0{R?)  is  equal  to  the  maximal  res¬ 
onant  ampliflcation  plotted  in  Fig.  2.  The  circles  mark  the  approximate 
Reynolds  numbers  (350,  1000)  at  which  Couette  and  PoiseuiUe  flows  are 
observed  to  undergo  transition  to  turbulence. 


small  perturbations  to  the  evolution  operator,  of  order  0{R~^),  suffice  to  make 
them  eigenvalue  unstable.  The  norm  of  the  minimal  destabilizing  perturba¬ 
tion  is  =  (supj^gjj  ||(u;/  — £)“*||)~*,  i.e.,  the  inverse  of  the  quantity  plotted 
in  Fig.  2  and  labeled  maximal  resonance  in  Table  1.  This  observation  pro¬ 
vides  a  new  interpretation  of  Fig.  2.  For  example,  although  PoiseuiUe  flow  with 
R  =  5000  is  eigenvalue  stable,  there  exists  a  perturbation  6  of  norm  1.21  x  10"^ 
that  renders  it  unstable.  See  Fig.  12. 

This  raises  the  question  of  the  physical  meaning  of  operator  perturbations 
and  what  relevance  they  may  have  to  flow'^  instabilities  observed  in  the  labora¬ 
tory.  (We  emphasize  that  is  a  perturbation  of  £,  not  of  the  flow  field  Wq.) 
The  minimal  destabilizing  perturbation  S  with  H^H  =  f.^j„  is  easily  character¬ 
ized:  it  is  a  rank-1  operator  of  the  form  avii*,  where  cr,v,n  are  the  principal 
singular  value  and  right  and  left  singular  vectors  of  respectively.  This  op¬ 
erator  transforms  streamwise  streaks  into  streamwise  vortices,  thereby  closing 
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the  loop  so  that  the  transient  growth  of  Figs.  8-9  can  feed  back  upon  itself  to 
become  modal  growth  for  all  t.  Of  course  there  is  no  reason  to  expect  such 
a  perfectly  contrived  perturbation  to  arise  under  natural  conditions.  What  is 
suggestive  is  that  even  random  perturbations  of  C  have  qualitatively  the  same 
effect.  At  i?  =  5000,  for  example,  approximately  90%  of  all  random  perturba¬ 
tions  £  to  C  with  ||£^||  =  10~^  render  a  Poiseuille  flow  eigenvalue  unstable,  where 
by  a  random  perturbation  we  mean  an  elementwise  random  perturbation  of  the 
20  X  20  matrix  that  represents  the  projection  of  £  onto  the  space  spanned  by  its 
20  dominant  eigenmodes  (with  fixed  a  =  0  and  ,3=  1.62).  Though  it  is  a  large 
step  from  such  matrices  to  shear  flows,  the  possibility  is  clearly  suggested  that 
seemingly  negligible  perturbations  may  destabilize  a  flow  even  in  the  narrow 
eigenvalue  sense.  One  can  imagine  that  imperfections  in  the  boundary  walls  of 
a  laboratory  apparatus,  for  example,  might  have  this  effect.  We  hope  that  fu¬ 
ture  investigations  will  reveal  whether  this  idea  of  perturbed  evolution  operators 
provides  an  explanation  of  instability  in  some  flows. 

A  different  prospective  application  of  the  idea  of  destabilizing  operator  per¬ 
turbations  may  be  to  the  theory  of  “secondary  instability*’  as  an  explanation  of 
subcritical  transition  to  turbulence  (8,  9).  This  theory  is  founded  on  the  discov¬ 
ery  that  when  certain  laminar  shear  flows  are  perturbed  by  certain  physically 
motivated  waves  of  large  amplitude,  the  resulting  problem  is  eigenvalue  unsta¬ 
ble,  with  eigenvalues  high  enough  in  the  upper  half-plane  to  match  observed 
time  scales  for  transition.  The  great  sensitivity  of  the  spectrum  of  C  to  pertur¬ 
bations,  however,  raises  the  question  of  whether  similar  eigenvalue  instabilities 
might  also  arise  with  the  use  of  more  or  less  arbitrary  perturbations,  not  just 
the  ones  that  have  been  considered  based  on  physical  arguments. 
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Nonlinear  bootstrapping  and  transition  to  turbulence 


Kelvin  wrote  in  1887  (19): 

It  seems  probable,  almost  certain  indeed,  that . . .  the  steady  motion  is  stable  for 
any  viscosity,  however  small;  and  that  the  practical  unsteadiness  pointed  out  by 
Stokes  forty-four  years  ago,  and  so  admirably  investigated  experimentally  five 
or  six  years  ago  by  Osborne  Reynolds,  is  to  be  explained  by  limits  of  stability 
becoming  narrower  and  narrower  the  smaller  is  the  viscosity. 


This  view  of  instability  is  still  the  standard  one,  but  to  this  day,  it  has  never  been 
confirmed  in  detail.  In  this  final  section  we  would  like  to  speculate  about  what 
the  eventual  confirmation  may  look  like — in  other  words,  about  how  nonlinear 
and  linear  mechanisms  interact  to  bring  about  transition  to  turbulence. 


Consider  the  2x2  nonlinear  model  problem 

^  =  Au  +  \\u\\Bu,  \ 

dt  n  II  ’  I  0  -2R-» 


where  E  is  a  large  parameter.  The  linear  term,  involving  the  non-normal  ma¬ 
trix  A,  amplifies  energy  transiently.  The  nonlinear  term,  involving  the  skew- 
symmetric  matrix  B,  rotates  energy  in  the  «i-«2  plane  but  does  not  directly 
create  or  destroy  energy,  since  it  acts  orthogonally  to  the  motion  (43).  Thus 
we  have  linear  amplification  coupled  with  energy-neutral  nonlinear  mixing,  a 
situation  that  holds  also  for  the  equations  of  fluid  mechanics  (44). 

Fig.  13  shows  norms  l|u(f)||  for  solutions  starting  from  eight  different  initial 
vectors  of  the  form  u(0)  =  (0,const)^,  with  R  =  2b.  For  ||u(0)||  <  10““*,  the 
curves  are  approximately  translates  of  one  another  on  this  log  scale,  indicating 
that  the  evolution  is  effectively  linear.  At  ||u(0)||  =  4  x  10“^,  the  nonlinearity 
has  begun  to  have  a  pronounced  effect.  At  ||«(0)lj  =  5  x  10“^  the  threshold  has 
been  crossed,  and  for  this  and  higher  amplitudes,  the  curves  do  not  decay  to 
zero  but  blow  up  to  a  critical  point  of  amplitude  w  1. 


Fig.  13  reveals  a  remarkable  phenomenon:  the  amplitude  growth  is  far 
greater  than  that  of  the  purely  linear  problem  du/dt  =  Am.  Table  2  lists  the 
linear  growth  factor  M  ~  i2/4  and  the  threshold  amplitude  c  (for  this  particular 
choice  of  initial  vector)  for  four  values  of  R.  Evidently  c  is  of  order  M~^,  not 
M~^.  This  “bootstrapping”  effect  can  be  explained  as  follows.  Suppose  the 
solution  at  <  =:  0  consists  of  a  vector  of  amplitude  €  in  a  direction  that  excites 
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Fig.  13.  ||u(<)||  vs.  t  for  solutions  to  a  nonlinear  2x2  model  problem  with 
various  initial  amplitudes.  The  threshold  amplitude  is  ||«(0)||  as  4.22 x  10~®. 


R 

linear 

growth 

factor 

M 

threshold 

amplitude 

c 

ratio 

12.5 

3.18 

3.41  X  10-3 

8.1 

8.0 

25 

6.28 

4.22  X  lO--* 

50 

12.5 

5.27x10-3 

100 

25.0 

6.58  X  10-« 

8.0 

Table  2.  The  “bootstrapping”  of  the  linear  growth  factor  M  =  0{R) 
causes  the  threshold  amplitude  to  be  0{R~^). 


growth  of  the  linear  problem  duldt  =  Au  (the  principal  right  singular  vector  of 
A).  At  a  later  time,  of  order  iZ,  the  solution  has  grown  to  order  iZc  by  the  linear 
growth  mechanism  but  moved  into  a  direction  that  no  longer  excites  growth  (the 
corresponding  left  singular  vector).  Meanwhile,  however,  the  nonlinear  term  has 
had  the  effect  of  transferring  some  of  this  energy  back  to  the  original  direction. 
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with  amplitude  R{Re)^  =  R^t^  since  the  nonlinearity  is  quadratic  and  the  time 
scale  is  0{R).  If  R^e^  is  of  order  less  than  t,  the  process  is  not  self-sustaining 
and  the  energy  dies  away.  On  the  other  hand  if  R^t~  is  of  order  greater  than  c, 
then  there  is  more  energy  than  was  present  at  the  start  and  feedback  occurs, 
leading  to  self- sustained  amplitude  growth.  Thus  the  threshold  amplitude  is 
e  =  0(i?-3). 

A  similar  experiment  shows  that  if  the  same  nonlinear  equation  is  driven 
by  a  forcing  oscillation  instead  of  an  initial  vector  «(0),  the  threshold 

amplitude  becomes  t  —  0{R~^). 

It  may  appear  at  first  sight  that  these  results  indicate  the  great  power  and 
importance  of  nonlinear  effects.  Yet  in  two  senses,  these  energy  growth  scenar¬ 
ios  are  essentially  linear.  First,  as  mentioned  above,  the  nonlinear  term  does 
not  add  energy  locally  but  merely  redistributes  it.  Second,  the  appearance  of 
the  bootstrapping  phenomenon  does  not  depend  on  the  precise  nature  of  the 
nonlinearity.  Any  quadratic  nonlinear  term  that  transfers  energy  from  decaying 
to  growing  solution  components  has  the  potential  of  inducing  a  threshold  ampli¬ 
tude  t  =  0{R~^)  or  with  respect  to  initial  or  forcing  data,  respectively; 

a  random  perturbation,  for  example,  will  often  suffice.  Higher-order  nonlinear¬ 
ities  also  lead  to  similar  effects,  though  the  exponents  may  be  lowered,  e.g.  to 
t  =  0{R~^)  and  0{R~^)  for  a  cubic  nonlinearity. 

The  Navier-Stokes  equations  are  certainly  more  complicated  than  our  2x2 
model.  One  difference  is  that  instead  of  2-vectors,  they  act  on  functions  with 
infinitely  many  degrees  of  freedom,  most  of  which  do  not  experience  non-normal 
linear  growth.  There  will  always  be  some  energy  in  the  growing  pseudomodes, 
however,  and  in  a  pipe  or  channel  of  substantial  extent,  random  fluctuations 
can  be  expected  to  raise  the  energy  levels  in  such  components  locally  well  about 
the  statistical  average  (45,  46).  Another  difference  is  that  the  nonlinear  in¬ 
teractions  in  the  Navier-Stokes  equations  act  across  different  wave  numbers  a 
and  /3  (13,  14),  making  the  exponent  of  2  in  our  model  perhaps  imrealistically 
low.  Despite  these  qualifications,  we  conjecture  that  the  transition  to  turbu¬ 
lence  of  eigenvalue-stable  shear  flows  proceeds  analogously  to  our  model  in  that 
the  destabilizing  mechanism  is  essentially  linear  in  the  senses  described  above, 
with  an  amplitude  threshold  for  transition  of  order  0(/{“)  for  some  o  <  -  1 . 
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Conclusion 

In  this  article  we  have  described  three  essentially  linear  approaches  to  the 
phenomenon  of  instability  of  shear  flows:  (i)  (pseudo-)  resonance,  (ii)  transient 
energy  growth,  and  (Hi )  destabilizing  operator  perturbations.  These  ideas  are  by 
no  means  independent.  Mathematically,  they  are  all  related  to  the  pseudospec¬ 
tra  of  the  operator  jC,  and  physically,  they  all  depend  on  the  same  mechanisms 
of  extraction  of  energy  from  the  mean  flow  by  streamwise  vortices  and  other 
structures.  One  should  not  expect  that  any  one  of  these  ideas  will  necessarily 
prove  to  be  the  “right”  one,  but  rather,  that  each  of  them  may  prove  appropriate 
to  a  particular  class  of  experiments.  For  example,  it  is  reasonable  to  speculate 
that  in  different  situations  transition  to  tinouience  may  be  primarily  triggered 
in  physically  quite  different  ways  by  (i)  laboratory  vibrations,  (ii)  initial  or  in¬ 
let  disturbances,  or  (Hi)  deviations  of  the  pipe  or  channel  geometry  from  the 
Poiseuille  or  Couettc  ideal. 

It  is  likely  that  in  the  upcoming  decade,  great  progress  will  be  made  in  elu¬ 
cidating  these  details.  Numerical  simulations  of  the  3D  Navier-Stokes  equations 
are  becoming  routine,  and  in  the  next  few  years  such  simulations  will  probably 
settle  at  last  the  question  mentioned  in  the  leist  section,  for  example,  of  how  the 
threshold  amplitude  for  transition  depends  on  the  Reynolds  number  in  various 
flow  situations. 

Besides  hydrodynamic  stability,  there  are  other  fields  also  where  highly 
non-orthogonal  eigenfunctions  arise  and  eigenvalues  may  be  misleading.  Exam¬ 
ples  in  fluid  mechanics  include  the  instability  of  magnetic  plasmas  (48)  and  the 
formation  of  cyclones  (49).  Two  more  examples  come  from  the  field  of  numeri¬ 
cal  analysis:  the  numerical  instability  of  discretizations  of  differential  equations 
(40)  and  the  convergence  of  iterative  algorithms  for  nonsymmetric  systems  of 
linear  equations  (50).  The  recurring  theme  in  these  and  other  applications  is 
that  although  the  long-time  behavior  of  an  evolving  system  may  be  controlled 
by  nonlinearities,  some  important  phenomena  are  of  a  short-time  nature  and 
essentially  linear  (51,  52).  If  the  linearized  problem  is  far  from  normal,  eigenval¬ 
ues  may  be  precisely  the  wrong  tool  for  analyzing  it,  for  eigenvalues  determine 
the  long-time  behavior  of  a  non-normal  linear  process,  not  the  transient.  We 
can  expect  to  see  further  examples  of  alternatives  to  eigenvalues  in  the  years 
ahead. 


Trefcthen,  Trefethen,  Reddy  and  Driscoll  -  26 


REFERENCES  AND  NOTES 


1.  P.  G.  Drazin  and  W.  H.  Reid,  Hydrodynamic  Stability  (Cambridge  U.  Press,  1981). 

2.  D.  D.  Joseph,  Stability  of  Fluid  Motions  I  (Springer  A^erlag,  1975). 

3.  This  article  is  adapted  from  L.  N.  Trefethen,  A.  E.  Trefethen,  S.  C.  Reddy,  Technical  Report 
No.  TR  92-1291  (Department  of  Computer  Science,  Cornell  University,  1992).  Readers 
interested  in  additional  details  are  urged  to  contact  the  first  author  for  a  copy  of  this 
report. 

4.  The  Reynolds  number  is  defined  by  R  —  LV  p/p.,  where  L  is  the  half-width  of  the  channel, 
V  is  the  maximum  velocity,  p  is  the  density,  and  p  is  the  viscosity.  The  distance,  velocity, 
and  time  variables  in  our  equations  are  nondimensionalized  by  L,  V,  and  L/V,  respectively. 

5.  S.  A.  Orszag,  J.  Fluid  Mech.  50,  689  (1971). 

6.  S.  J.  Davies  and  C.  M.  White,  Proc.  Roy.  Soc.  A  119,  92  (1928);  V.  Patel  and  M.  R.  Head, 
J.  Fluid  Mech.  38,  181  (1969);  D.  R.  Carlson,  S.  E.  Widnall,  and  M.  F.  Peeters,  ibid.  121, 
487  (1982). 

7.  N.  Tillmark  and  P.  H.  Alfredsson,  J.  Fluid  Mech.  235,  89  (1992). 

8.  S.  A.  Orszag  and  A.  T.  Patera,  J.  Fluid  Mech.  128,  347  (1983). 

9.  B.  J.  Bayly,  S.  A.  Orszag,  T.  Herbert,  Ann.  Rev.  Fluid  Mech.  20,  359  (1988). 

10.  T.  Kato,  Perturbation  Theory  for  Linear  Operators  (Springer- Verlag,  1976). 

11.  A.  Pazy,  Semigroups  of  Linear  Operators  and  Applications  to  Partial  Differential  Equations 
(Springer- Verlag,  1983). 

12.  S.  C.  Reddy,  P.  J.  Schmid,  D.  S.  Henningson,  SIAM  J.  Appl.  Math.  53,  in  press. 

13.  L.  H.  Gustavsson,  J.  Fluid  Mech.  224,  241  (1991). 

14.  D.  S.  Henningson,  in  Advances  in  Turbulence,  A.  V.  Johansson  and  P.  H.  Alfredsson  Eds. 
(Springer- Verlag,  1991),  pp.  279-284;  D.  S.  Henningson,  A.  Lundbladh,  A.  V.  Johansson, 
J.  Fluid  Mech.,  in  press. 

15.  K.  M.  Butler  and  B.  F.  Farrell,  Phys.  Fluids  A  4,  1637  (1992). 

16.  S.  C.  Reddy  and  D.  S.  Henningson,  “Energy  growth  in  viscous  channel  flows,”  to  appear. 

17.  Closely  related  recent  developments  are  described  in  K.  S.  Breuer  and  J.  H.  Haritonidis, 
J.  Fluid  Mech.  220  ,  569  (1990)  and  Y.  Bun  and  W.  O.  Criminale,  “Evolution  of  three 
dimensional  disturbances  in  a  mixing  layer,”  submitted. 

18.  See,  e.g..  Figs.  4.11,  4.15,  5.5  of  (1).  To  be  precise,  the  figures  that  have  appeared  in  the 
literature  have  the  x  wavenumber  a  as  the  ordinate,  not  the  x-z  wave  number  magnitude 
it  =  (a^-b/?^)*/^,  and  thus  correspond  to  2D  perturbations  only.  This  changes  the  upper 
boundary  in  such  a  way  that  the  black  region  shrinks  to  zero  width  as  R—*oo. 

19.  Lord  Kelvin  (W.  Thomson),  Phil.  Mag.  24,  188  (1887). 

20.  W.  M’F.  Orr,  Proc.  Roy.  Irish  Acad.  A  27,  9  and  69  (1907). 

21.  K.  M.  Case,  J.  Fluid  Mech.  10,  420  (1960)  and  Phys.  Fluids  3,  143  (1960). 


Trefethen,  Trefethen,  Reddy  and  Driscoll  -  27 


22.  G.  Rosen,  Phys.  Fluids  14,  2767  (1971);  D.  J.  Benney  and  L.  H.  Gustavsson,  Stud.  Appl. 
Math.  64,  185  (1981);  L.  S.  Hultgren  and  L.  H.  Gustavsson,  Phys.  Fluids  24,  1000  (1981), 
B.  F.  Farrell,  ibid.  31,  2093  (1988). 

23.  A.  D.  D.  Craik  and  W.  O.  Criminale,  Proc.  Roy.  Soc.  A  406,  13  (1986). 

24.  H.  B.  Squire,  Proc.  Roy.  Soc.  A  142,  621  (1933). 

25.  P.  S.  Klebanoff,  K.  D.  Tidstrom,  L.  M.  Sargent,  J.  Fluid  Mech.  12,  1  (1962);  R.  Breidenthal, 
ibid.  109,  1  (1981);  L.  P.  Bernal  and  A.  Roshko,  ibid.  170,  499  (1986);  J.  C.  Lasheras  and 
H.  Choi,  ibid.  189,  53  (1988);  M.  Asai  and  M.  Nishioka,  ibid.  208,  1  (1989);  S.  K.  Robinson, 
Tech.  Memo.  NASA  TM-103859.  NASA,  1991. 

26.  This  process  is  sometimes  called  “lift-up;”  see  M.  T.  Landahl,  SIAM  J.  Appl.  Math.  28, 
735  (1975). 

27.  The  term  pseudospectrum  is  due  to  L.  N.  Trefethen;  see  e.g.  L.  N.  Trefethen,  in  Numerical 
Analysis  1991,  D.  F.  Griffiths  and  G.  A.  Watson  Eds.  (Longman,  1992),  pp.  234-266. 
Essentially  the  same  idea  has  been  applied  over  the  years  by  various  authors  including  J. 
M.  Varah,  J.  W.  Demmel,  and  especially  S.  K.  Godunov  and  his  colleagues  in  the  former 
Soviet  Union.  Perhaps  its  earliest  application  is  by  H.  J.  Landau,  J.  Opt.  Soc.  Am.  66,  525 
(1976). 

28.  Our  computations  have  been  carried  out  on  a  Connection  Machine  System  CM-5  in  Fortran 
and  on  Sun  workstations  in  Matlab,  using  numerical  methods  adapted  from  those  of  Redd> 
and  Henningson  (12,  13,  14,  16).  First  the  problem  is  Fourier  transformed  in  x  and  z,  and 
the  working  variables  are  taken  as  the  y  components  of  velocity  and  vorticity;  a  weighted 
norm  is  introduced  for  these  variables  that  is  equivalent  to  the  energy  norm  HH.  The  ID 
problem  is  discretized  by  a  Chebyshev  hybrid  spectral  method  and  then  projected  onto  a 
space  spanned  by  a  set  of  dominant  eigenmodes,  leading  to  matrices  typically  of  size  about 
80  X  80.  In  the  Poiseuille  case  the  odd  and  even  solutions  with  respect  to  y  decouple,  and 
we  take  advantage  of  this  separation.  The  generation  of  most  of  our  figures  requires  an 
optimization  with  respect  to  a  or  0  or  both.  The  largest  calculations  are  required  for  the 
pseudospectra  of  Figs.  4  and  5,  which  are  determined  by  evaluating  IKw/ —  £)“'||  on  a 
grid  in  the  w-plane  of  typical  size  64  x  64  and  plotting  contours  of  the  resulting  data  array. 
For  each  value  of  w  on  the  grid,  ||(w/  — £)“*||  is  computed  by  numerical  minimization  of 
|)(w/  —  £„/j)“'ll“'  with  respect  to  a  and  0,  and  each  evaluation  of  this  function  entails  a 
matrix  singular  value  decomposition  (SVD). 

29.  L.  M.  Mack,  J.  Fluid  Mech.  73,  497  (1976). 

30.  The  principal  difference  is  that  the  spectra  and  pseudospectra  are  broader  in  Fig.  5  than 
in  Fig.  4.  This  is  a  consequence  of  the  fact  that  the  mean  flow  velocity  is  zero  for  Couette 
flow  but  nonzero  for  Poiseuille  flow,  so  that  a  plane  wave  of  wavenumber  a  traveling  with 
the  mean  flow  will  have  w  ss  0  for  Couette  flow  but  ui  =  O(o)  for  Poiseuille  flow.  Figs.  4  and 
5  look  different  if  the  Navier-Stokes  problem  is  formulated  in  a  moving  reference  frame, 
though  the  behavior  along  the  imaginary  axis  is  essentially  unchanged. 

31.  The  angle  is  0%  16.4®  as  measured  in  the  energy  inner  product,  corresponding  to  an  eigen¬ 
value  condition  number  k  =  l/sin0  as  3.52.  Thus  the  small  bump  in  the  f  =  10“^  ®  pseu- 
dospectral  contour  of  Fig.  5b  lies  at  a  distance  3.52  x  10"®  ®  from  the  spectrum. 

32.  Similar  figures  appear  in  (15).  Detailed  discussions  of  the  differences  between  structures 
with  a  =  0,  a  /  0,  etc.  can  be  found  there  and  in  B.  F.  Farrell  and  P.  J.  loannou,  “Optimal 
excitation  of  3D  perturbations  in  viscous  constant  shear  flow,”  to  appear.  In  the  present 
paper  we  have  oversimplified  somewhat  by  emphasizing  only  streamwise  structures. 


Trefethen,  Trefethen,  Reddy  and  Driscoll  -  28 


33.  This  figure  is  modeled  after  Fig.  13  of  (12),  an  analogous  plot  for  2D  perturbations  only. 

34.  It  h^ls  been  conjectured  that  the  pseudospectra  of  a  matrix  or  linear  operator  £  determine 
||exp(— j<£)j(  and  indeed  any  quantity  ((/(£)||  exactly,  not  just  approximately  via  inequal¬ 
ities  (A.  Greenbaum  and  L.  N.  Trefethen,  “GMRES/CR  emd  Arnoldi/Lanczos  as  matrix 
approximation  problems,”  to  appear).  As  of  this  writing,  the  validity  of  this  conjecture  is 
unresolved. 

35.  G.  H.  Golub  and  C.  F.  Van  Loan,  Matrix  Computations  (Johns  Hopkins  U.  Press,  1989); 
R.  A.  Horn  and  C.  R.  Johnson,  Topics  in  Matrix  Analysis  (Cambridge  U.  Press,  1991). 

36.  J.  Serrin,  Arch.  Rat.  Mech.  Anal.  3,  1  (1959);  F.  H.  Busse,  Z.  Angew.  Math.  Phys.  20, 
1  (1969);  J.  L.  Lumley,  in  Developments  in  Mechanics,  Vol.  6,  L.  H.  N.  Lee  and  A.  H. 
Szewczyk  Eds.  (Notre  Dame  Press,  1971),  pp.  63-88. 

37.  Lord  Rayleigh,  Proc.  London  Math.  Soc.  11,  57  (1880). 

38.  T.  Ellingsen  and  E.  Palm,  Phys.  Fluids  18,  487  (1975). 

39.  M.  T.  Landahl,  J.  Fluid  Mech.  98,  243  (1980). 

40.  This  point  has  been  better  appreciated  in  the  field  of  numerical  analysis  of  discrete  methods 
for  the  solution  of  differential  equations.  The  proper  definition  of  numerical  stability,  due 
to  P.  D.  Lax  and  R.  D.  Richtmyer,  is  uniform  with  respect  to  a  mesh  size  parameter,  and 
the  importance  of  uniform  estimates  was  made  especially  clear  by  the  work  of  H.-O.  Kreiss 
in  the  1960s.  See  (42)  and  R.  D.  Richtmyer  and  K.  VV.  Morton,  Difference  Methods  for 
Initial-Value  Problems  (Wiley-Interscience,  1967). 

41.  The  spectrum  A(£)  and  pseudospectra  Aj(£)  are  discontinuous  as  R— *  oc:  for  both  Couette 
and  PoiseuiUe  flow  with  R  =  oo  the  spectrum  is  the  real  axis,  not  the  lower  half-plane, 
and  preliminary  results  suggest  that  the  pseudospectra  are  approximately  parallel  strips 
centered  on  the  real  axis.  (The  dbi  symmetry  is  a  consequence  of  the  reversibility  of  inviscid 
flows.)  These  discontinuities  do  not  reflect  any  genuine  difficulty  with  the  limit  R—*oc, 
however,  for  it  is  only  the  pseudospectra  in  the  upper  half-plane  that  have  quantitative 
consequences,  and  these,  so  far  as  we  know,  are  continuous. 

42.  S.  C.  Reddy  and  L.  N.  Trefethen,  Sumer.  Math.  62,  236  (1992). 

43.  The  fact  that  the  nonlinear  term  does  not  create  or  destroy  energy  can  be  seen  algebraically 
from  the  absence  of  B  from  the  easily  verified  formula d|(«||Vd<  =  vT{Af  A^)u. 

44.  The  equation  for  d||w||^/dt  is  called  the  Reynolds-Orr  equation  (1,2).  In  fact  our  2x2 
model  is  not  so  far  from  the  interaction  of  vortex  “tilting”  and  “stretching”  described  in 
(8),  p.  369. 

45.  We  have  not  discussed  the  relationship  between  spatially  global  and  local  results,  which  is 
somewhat  obscured  by  modal  or  pseudomodal  analysis,  since  different  wave  numbers  Q,/d 
decouple  orthogonally.  A  related  matter  is  the  investigation  of  spatial  rather  than  temporal 
evolution  of  flow  disturbances,  which,  according  to  preliminary  results  of  P.  J.  Schmid 
(personal  communication),  produces  results  qualitatively  analogous  to  those  reported  here. 

48.  Preliminary  numerical  experiments  support  the  idea  that  even  random  fluctuations  tend 
to  excite  growing  pseudomodes.  A  theory  of  the  non-normal  response  of  linearized  flows  to 
stochastic  forcing  data  has  been  developed  in  B.  F.  Farrell  and  P.  J.  loannou,  “Stochastic 
forcing  of  the  linearized  Navier-Stokes  equations,”  to  appear.  In  the  language  of  numerical 
linear  algebra,  this  work  is  related  to  the  integral  of  the  squared  Frobenius  norm  of  the 
evolution  operator  exp(— if£)  (sum  of  squares  of  all  singular  values)  rather  than  the  energy 
norm  (largest  singular  value). 


Trefethen,  Trefethen,  Reddy  and  Driscoll  -  29 


47.  P.  J.  Schmid  and  D.  S.  Henningson,  Pbys.  Fluids  A  4,  1986  (1992). 

48.  W.  Kerner,  J.  Comp.  Phys.  85,  1  (1989). 

49.  B.  F.  Farrell,  J.  Atmos.  Sci.  46,  1193  (1989). 

50.  N.  M.  Nachtigal,  S.  C.  Reddy,  L.  N.  Trefethen,  SIAM  J.  Matrix  Anal.  Appl.  13,  778  (1992); 
N.  M.  NachtigeJ,  L.  Reichel,  L.  N.  Trefethen,  ibid.,  796. 

51.  D.  J.  Higham  and  L.  N.  Trefethen,  “Stiffness  of  ODEs,”  BIT,  in  press. 

52.  There  is  evidence  that  this  statement  applies  even  to  fully  developed  turbulence.  See  M.  J. 
Lee,  J.  Kim,  P.  Moin,  J.  Fluid  Mech.  216,  561  (1990)  and  K.  M.  Butler  and  B.  F.  Feirrell, 
“Optimal  perturbations  and  streak  spacing  in  wall-bounded  turbulent  shear  flow,”  Phys. 
Fluids  A,  in  press. 

53.  Supported  by  NSF  Grant  DMS-9116110  (L.N.T).  We  acknowledge  with  gratitude  the  com¬ 
ments  of  Kathryn  Butler,  Brian  Farrell,  Bengt  Fornberg,  Dan  Henningson,  Philip  Holmes, 
Petros  loannou,  Peter  Schmid,  Ridgway  Scott,  and  Eric  Siggia,  and  also  extensive  CM-5 
computer  time  generously  donated  by  Thinking  Machines  Corporation. 


REPORT  DOCUMENTATION  PAGE 


Form  Approved 
0MB  NO  0704  0188 


J. 


Public  fepocting  burden  for  ihi%  collection  of  informaiior>  is  esttmateo  to  average  '  nour  oer  r*u>orse  tnciuOing  the  time  for  reviesemg  instructions,  searching  stmg  data  sources 
gathering  and  maintaining  the  data  needed,  and  completing  and  review*ing  the  collection  of  information  Send  comments  feaaromg  this  burden  estimate  or  an-  otner  aspect  of  this 
collection  of  information,  including  suggestions  for  reducing  this  buroen  to  i/irashington  Heaoouarters  Services.  Directorate  for  information  Operations  and  Peoons.  U’S  jetterson 
Davis  Highway,  Suite  >204.  Arlington.  i/A  22202*4302.  and  to  tne  Off'ceof  Management  and  Budget.  PaperworK  Reduction  Project  (0704-0 1 88).  Wasnmgton.  DC  20S03 

1.  AGENCY  USE  ONLY  (Leave  blank)  2.  REPORT  DATE  3.  REPORT  TYPE  AND  DATES  COVERED 

December  1992  Contractor  Reoort 

4.  TITLE  AND  SU8TITLE 

A  NEW  DIRECTION  IN  HYDRODYNAMIC  STABILITY:  BEYOND 
EIGENVALUES 

5.  FUNDING  NUMBERS 

C  NASl-19480 

WU  505-90-52-01 

6.  AUTHOR(S) 

Lloyd  N.  Trefethen,  Anne  E.  Trefethen,  Satlsh  C.  Reddy, 
and  Tobin  A.  Driscoll 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADORESS(ES) 

Institute  for  Computer  Applications  in  Science 
and  Engineering 

Mall  Stop  132c,  NASA  Langley  Research  Center 

Hampton,  VA  23681-0001 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

ICASE  Report  No.  92-71 

9.  SPONSORING /MONITORING  AGENCY  NAME(S)  AND  AOORESS(ES) 

National  Aeronautics  and  Space  Administration 

Langley  Research  Center 

Hampton,  VA  23681-0001 

10.  SPONSORING /MONITORING 

AGENCY  REPORT  NUMBER 

NASA  CR-191411 

ICASE  Report  No.  92-71 

11.  SUPPLEMENTARY  NOTES 

Submitted  to  Science 

Langley  Technical  Monitor:  Michael  F.  Card 

Final  Report 

12a.  DISTRIBUTION /AVAILABILITY  STATEMENT 

Unclassified  -  Unlimited 

Subject  Category  34 

12b.  DISTRIBUTION  CODE 

13.  ABSTRACT  (Maximum  200  words) 

Fluid  flows  that  are  smooth  at  low  speeds  become  unstable  and  then  turbulent  at 
higher  speeds.  This  phenomenon  has  traditionally  been  investigated  by  linearizing 
the  equations  of  flow  and  looking  for  unstable  eigenvalues  of  the  linearized  problem, 
but  the  results  agree  poorly  in  many  cases  with  experiments.  Nevertheless,  it  has 
become  clear  in  recent  years  that  linear  effects  play  a  central  role  in  hydrodynamic 
instability.  A  reconciliation  of  these  findings  with  the  traditional  analysis  can  be 
obtained  by  considering  the  "pseudospectra”  of  the  linearized  problem,  which  reveals 
that  small  perturbations  to  the  smooth  flow  in  the  form  of  streamwise  vortices  may 
be  amplified  by  factors  on  the  order  of  10^  by  a  linear  mechanism,  even  though  all 
the  elgenmodes  are  stable.  The  same  principles  apply  also  to  other  problems  in  the 
mathematical  sciences  that  Involve  non-orthogonal  eigenfunctions. 

14.  SUBJEa  TERMS 

hydrodynamic  stability;  transition  to  turbulence 

17.  SECURITY  aASSIFICATION 
OF  REPORT 

Unclassified 

18.  SECURITY  aASSIFICATION 
OF  THIS  PAGE 

Unclassified 

19.  SECURITY  CLASSIFICATION 
OF  ABSTRACT 

20.  LIMITATION  OF  ABSTRACT 

NSN  7S40.01-280-SS00  Standard  Form  298  {Rev  2-89) 


vrncntwd  by  ANSI  Sid  tn-K 


NASA-l^d*^' 


National  Aeronautics  and 
Space  Administration 
Code  JTT 
Washington,  D.C. 
20546-0001 

OfHctal  Business 

Penalty  tor  Private  Use,  $300 


IVIASA 


POSTMASTER  I’  UndeHverable  (Section  158 
Postal  Manual)  Do  Not  Return 


